Papers by Hyo Jin Do
Synthetic Data for Evaluation: Supporting LLM-as-a-Judge Workflows with EvalAssist (2025.emnlp-demos)
Copied to clipboard
Martín Santillán Cooper, Zahra Ashktorab, Hyo Jin Do, Erik Miehling, Werner Geyer, Jasmina Gajcin, Elizabeth M. Daly, Qian Pan, Michael Desmond
| Challenge: | EvalAssist is a web-based application designed to assist human-centered evaluation of language model outputs. |
| Approach: | They propose a synthetic data generation tool integrated into EvalAssist to assist human-centered evaluation of language model outputs. |
| Outcome: | The proposed tool supports flexible prompting, RAG-based grounding, persona diversity, and iterative generation workflows. |
Multi-Level Explanations for Generative Language Models (2025.acl-long)
Copied to clipboard
Lucas Monteiro Paes, Dennis Wei, Hyo Jin Do, Hendrik Strobelt, Ronny Luss, Amit Dhurandhar, Manish Nagireddy, Karthikeyan Natesan Ramamurthy, Prasanna Sattigeri, Werner Geyer, Soumya Ghosh
| Challenge: | Large language models (LLMs) are being used for context-grounded tasks like summarizing meetings and answering doctors' questions. |
| Approach: | They propose a technique to provide explanations for context-grounded text generation by assigning scores to parts of the context to quantify their influence on the model output. |
| Outcome: | The proposed framework can provide more faithful explanations of generated output than available alternatives, including LLM self-explanations. |